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ABSTRACT 

A study of science and math education systemic reform in 
rural schools aimed to help educators understand and build upon the inherent 
strengths of rural schools and communities that support systemic reform. The 
first phase of the study involved developing a system of indicators for each 
of six drivers of educational system reform: 1) implementation of standards- 
based curricula throughout the system; 2) development of policies that 
support high-quality mathematics and science education through preparation, 
continuing education, and support for mathematics and science teachers; 3) 
convergence of all resources that support science and mathematics education 
into a focused program to improve mathematics and science education for all 
students; 4) support from parents, policymakers, institutions of higher 
education, business, and other segments of the community; 5) accumulation of 
evidence that the program enhances student achievement; and 6) improvement in 
achievement of all students, including those historically underserved. A 
literature review yielded 123 indicators of reform. Through a two-round 
Delphi procedure, a 10-member research advisory team validated 75 indicators 
and linked them to specific drivers of educational system reform. Appendices 
contain 35 references, the list of indicators, research advisory team 
members, results of round one, and frequency tables. (TD) 
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Executive Summary 

The National Science Foundation funded a proposal submitted by Western Michigan University s 
Evaluation Center to study science and math education systemic reform in rural communities. 

The study approaches the challenge from the unicjue perspectives of rural communities. The 
project will help math and science educators build upon the inherent strengths of rural schools and 
better understand the factors inherent in rural schools and communities that support or serve as 
barriers to systemic reform. 

An extensive review was conducted of the systemic reform, evaluation of systemic reform, and 
rural education literature (Appendix 1). The purpose of the literature review was twofold: (1) to 
identify indicators for consideration in the Delphi procedure and (2) to serve as the basis for a 
background paper on rural systemic reform (Russon & Horn, 1999). From these sources, and 
with input from the project’s Resource Advisory Team, 1 72 indicators were identified. The list of 
indicators was reviewed and duplicates were omitted. The final list contained 123 indicators. 

The 123 indicators that were identified during the literature review formed the basis of a 
questionnaire (Appendix 2). The questionnaire was administered to members of the Resource 
Advisory Team (Appendix 3). The team was instructed to read the description of each indicator 
and decide to which of the six drivers of educational system reform the indicator most strongly 
related. If the indicator was not found to correspond to any of the drivers they were to mark 
“Not Applicable.” The results of the first round of the Delphi process showed that 29 indicators 
were validated (80 percent agreement) by the Resource Advisory Team: 4 for Driver 1, 10 for 
Driver 2, 3 for Driver 3, 5 for Driver 4, 5 for Driver 5, and 2 for Driver 6 (Appendix 4). 

The results of the first round of the Delphi process were compiled along with comments. These 
were disseminated to the Resource Advisory Team along with a clean copy of the questionnaire. 
The team members were asked to review their colleagues’ responses and complete the 
questionnaire again, modifying their responses as they deemed appropriate. The results of the 
second round of the Delphi process show that 75 indicators were validated (approximately 80 
percent agreement) by the Resource Advisory Team: 19 for Driver 1, 23 for Driver 2, 10 for 
Driver 3, 7 for Driver 4, 13 for Driver 5, and 3 for Driver 6. 
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Introduction 

The National Science Foundation funded a proposal submitted by Western Michigan University’s 
Evaluation Center to study science and math education systemic reform in rural communities. 

The study approaches the challenge from the unique perspectives of rural communities. The 
project will help math and science educators build upon the inherent strengths of rural schools and 
better understand the factors inherent in rural schools and communities that support or serve as 
barriers to systemic reform. The original objectives of the study are listed below: 

1 To develop a system of indicators around each of the identified six drivers of educational 
system reform 

2. To determine the perceived relative importance and value of each of the drivers and 
indicators for reform in RSI schools in selected communities 

3 To determine the status of innovation/reform within selected communities with respect to 
factors thought to support or serve as barriers to innovation and education reform 

4. To determine the ways and the extent to which the perceived importance and value of the 
drivers and the characteristics of the community impact on systemic reform efforts and 
student achievement in mathematics, science, and technology 

Phase I of the project was designed to accomplish the first objective of the study. The tasks 
contained in this phase include the following: 

Task I. A. Review the literature for descriptions of evidence that may be reasonably determined to 
be related to each driver. 

Task I.B. Using a modified 2-round Delphi procedure, the Resource Advisory Team will match 
indicators with drivers. The results of Round 2 will be submitted to the three selected RSI 
directors for comment. These comments and the results of the Round 1 Delphi results will be 
submitted to the Resource Advisory Team for Round 2 of the Delphi. (An agreement of 80 
percent [8 of 10] on Round 2 will serve as the criterion for validation of an indicator or a driver.) 

Task I.C. Analyze the results of the Delphi procedure and develop a list of validated indicators 
for each driver. 

This report describes of the literature search and reports the results of Rounds 1 and 2 of the 
Delphi procedure. 
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Literature Review 

An extensive review was conducted of the systemic reform, evaluation of systemic reform, and 
rural education literature (Appendix 1). The purpose of the literature review was twofold: (1) to 
identify indicators for consideration in the Delphi procedure and (2) to serve as the basis for a 
background paper on rural systemic reform (Russon & Horn, 1999). From these sources, and 
with input from the project’s Resource Advisory Team, 172 indicators were identified. The list of 
indicators was reviewed and duplicates were omitted. The final list contained 123 indicators. 

Round 1 of the Delphi Procedure 

The 123 indicators that were identified during the literature review formed the basis of a 
questionnaire (Appendix 2). The questionnaire was administered to members of the Resource 
Advisory Team (Appendix 3). The team was instructed to read the description of each indicator 
and decide to which of the six drivers of educational system reform the indicator most strongly 
related. If the indicator was found not to correspond to any of the drivers, they were to mark 
“Not Applicable.” 

Only nine of the ten team members returned the questionnaire during the first round of the Delphi. 
The results were somewhat difficult to interpret because some team members marked more than 
one answer. Twenty-nine indicators were validated by 80 percent or more of the team members 
(Appendix 4): 

Driver 1 . Implementation of comprehensive, standards-based curricula as represented in 
instructional practice, including student assessment, in every classroom, laboratory, and other 
learning experience provided through the system and its partners. 

1 . Curriculum is of high quality and aligned with national standards. 

69. Teachers reference standards in selecting curriculum. 

70. Teachers report use of recognized standards. 

71 . Assessments are aligned with standards and curriculum 

Driver 2 . Development of a coherent, consistent set of policies that supports provision of 
high quality mathematics and science education for each student, excellent preparation, continuing 
education, support for each mathematics and science teacher, and administrative support for all 
persons who work to dramatically improve achievement among students served by the system. 

5. Professional development program in place to train teachers to implement high quality 
curriculum. 

6. Teachers and staff participate in professional development program. 

7. Policies indicate a coherent vision that encompasses all students. 

9. Policies strengthen the emphasis on mathematics, science, and technology. 

10. Policies support the preservice education of teachers. 
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1 1 Policies assure adequate time for the ongoing professional development of teachers. 

12. Policies require a tight alignment among curriculum, instruction, assessment, and 
professional development. 

34. Professional development requirements have been changed. 

80. Professional development focuses on program and student needs. 

121 . School policy is effective for guiding practice. 

Driver 3 . Convergence of the usage of all resources that are designed for or that 
reasonably could be used to support science and mathematics education— fiscal, intellectual, 
material, curricular, and extracurricular— into a focused and unitary program to constantly 
upgrade, review, and improve the educational program in mathematics and science for all 

students. 

16. Existing funding sources support systemic reform. 

20. Technology and telecommunications are used to support education. 

73. Resource decisions are based/focused on improvement for all students. 

Driver 4 . Broad-based support from parents, policymakers, institutions of higher 
education, business and industry, foundations, and other segments of the community for goals and 
collective value of the program, based on rich presentations of the ideas behind the program, the 
evidence gathered about its successes and its failures, and critical discussions of its efforts. 

18. There is coordination between the initiative and other stakeholders. 

21 . A comprehensive effort maximizes broad-based support for program goals. 

23 The goal of improving the achievement of all students has been embraced by all relevant 
stakeholders. 

24. All relevant stakeholders understood and accepted systematic change as a strategy for 
improving education. 

63 . Parent organizations, community-based organizations, business-industry, and higher 
education are collaborating in support of the reform. 

Driver 5 . Accumulation of a broad and deep array of evidence that the program is 
enhancing student achievement, through a set of indices that might include achievement test 
scores, higher level courses passed, college admission rates, college majors, Advanced Placement 
tests taken, portfolio assessment, and ratings from summer employers that demonstrate that 
students are generally achieving at a significantly higher level in science and mathematics. 

44. Data relative to implementation of RSI are being collected. 

88. Outcomes from science and math programs are available for public scrutiny. 

89. Multiple methods are used to assess students and programs. 

91 . Efforts are made to follow up on graduates. 

102. Percentage of students taking Advanced Placement exams has risen. 
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Driver 6 . Improvement in the achievement of all students, including those historically 
underserved. 

29. All students (including historically underserved) show increased scores on measures of 
learning. 

101. Standardized tests show improvement in minority student achievement. 

Round 2 of the Delphi Procedure 

The results of the first round of the Delphi process were compiled along with comments. These 
were disseminated to the Resource Advisory Team along with a clean copy of the questionnaire. 
The team members were asked to review their colleagues’ responses and complete the 
questionnaire again, modifying their responses as they deemed appropriate. Emphasis was placed 
on the importance of marking one response per indicator. Once again, only nine of the ten team 
members returned the questionnaire. This time, 75 indicators were validated by approximately 80 
percent or more of the team members (Appendix 5): 

Driver 1 . Implementation of comprehensive, standards-based curricula as represented in 
instructional practice, including student assessment, in every classroom, laboratory, and other 
learning experience provided through the system and its partners. 

1 . Curriculum is of high quality and aligned with national standards. 

2. High quality curriculum implemented with all students. 

47. Extent of standards-based curriculum implementation in classroom. 

49. Hands-on, inquiry-based instruction is occurring in classrooms. 

56. Student-teacher-curriculum interactions are taking place at the classroom level. 

64. Teachers are able to articulate instructional standards. 

66. Teachers understand the K- 1 2 curriculum. 

69. Teachers reference standards in selecting curriculum. 

70. Teachers report use of recognized standards. 

71 . Assessments are aligned with standards and curriculum. 

79. Planning and teaching occurs across disciplines. 

82. Curriculum/instruction are relevant to the locale of the student. 

87. RSI courses are taught/offered regularly across K-12 levels. 

94. Students have opportunities to learn about careers and educational requirements in science 
and math. 

109. Curriculum and instruction goals are coordinated with relevant need areas. 

1 16. Curriculum activities are organized to promote continuity of learning for students. 

117. Activities are selected and arranged to provide a broad and coordinated educational 
program. 

1 19. Instructional activities are systematically planned, organized, and implemented in light of 
curricular goals. 

120. Activities are changed to improve curriculum. 
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Driver 2 . Development of a coherent, consistent set of policies that supports provision of 
high quality mathematics and science education for each student, excellent preparation, continuing 
education, support for each mathematics and science teacher, and administrative support for all 
persons who work to dramatically improve achievement among students served by the system. 

5 Professional development program in place to train teachers to implement high quality 
curriculum. 

6. Teachers and staff participate in professional development program. 

7. Policies indicate a coherent vision that encompasses all students. 

8. Policies require that all students be enrolled in high quality and rigorous programs. 

9. Policies strengthen the emphasis on mathematics, science, and technology. 

1 0. Policies support the preservice education of teachers. 

1 1 . Policies assure adequate time for the ongoing professional development of teachers. 

1 2. Policies require a tight alignment among curriculum, instruction, assessment, and 
professional development. 

13. Policies assure adequate financial and administrative support for the ongoing professional 
development of teachers. 

14. Policies designed to recognize and reward excellence in teaching. 

15. Policies support the system’s capacity to collect and use data for continuous program 
improvement. 

34. Professional development requirements have been changed. 

3 5 . Teacher certification requirements were changed. 

50. Teachers implementing inquiry-based learning receive planning time, mentor teacher 
assistance, opportunity for continuing professional development. 

5 1 . Teachers are trained in the use of assessments. 

80. Professional development focuses on program and student needs. 

81 . Teachers are selected and retained on the basis of qualifications and value added to 
student learning. 

83. Q ualifi ed teachers are encouraged to remain in rural, small schools. 

110. Procedures for developing and modifying curriculum and instruction objectives are in 

place. 

113. Qualifications, assignment; and support of personnel in the curriculum area are 
appropriate. 

121 . School policy is effective for guiding practice. 

122. School policy is implemented adequately. 

1 23 . The policy review and revision process is effective. 

Driver 3 . Convergence of the usage of all resources that are designed for or that 
reasonably could be used to support science and mathematics education— fiscal, intellectual, 
material, curricular, and extracurricular— into a focused and unitary program to constantly 
upgrade, review, and improve the educational program in mathematics and science for all 
students. 
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16. Existing funding sources support systemic reform. 

1 7. Additional funds have been leveraged in support of improving education. 

20. Technology and telecommunications are used to support education. 

37. The budget percentage dedicated to education increased. 

38. Percentage of targeted funds such as Title 1, Perkins, and Eisenhower used in direct 
support of RSI. 

39. There have been changes in the student to teacher ratio. 

4 1 . Facilities provide access to learning technologies. 

73 . Resource decisions are based/focused on improvement for all students. 

84. Resources are made available for work beyond the school day/year on planned, focused 
areas. 

85. Funds are pooled to enhance professional development and other activities for 
improvement. 

Driver 4 . Broad-based support from parents, policymakers, institutions of higher 
education, business and industry, foundations, and other segments of the community for goals and 
collective value of the program, based on rich presentations of the ideas behind the program, the 
evidence gathered about its successes and its failures, and critical discussions of its efforts. 



1 8. There is coordination between the initiative and other stakeholders. 

21 . A comprehensive effort maximizes broad-based support for program goals. 

22. There are increases in the level of support among all relevant stakeholders. 

23. The goal of improving the achievement of all students has been embraced by all relevant 
stakeholders. 

24. All relevant stakeholders understood and accepted systematic change as a strategy for 
improving education. 

63. Parent organizations, community-based organizations, business-industry, and higher 
education are collaborating in support of the reform. 

65. Students, teachers, and community members share a common understanding of expected 
outcomes. 

Driver 5 . Accumulation of a broad and deep array of evidence that the program is 
enhancing student achievement, through a set of indices that might include achievement test 
scores, higher level courses passed, college admission rates, college majors, Advanced Placement 
tests taken, portfolio assessment, and ratings from summer employers that demonstrate that 
students are generally achieving at a significantly higher level in science and mathematics. 

25. High-quality courses experienced an increase in student enrollment. 

30. Number and percentage of students presently affected by global system changes. 

36. Accountability measures were developed for all system levels. 

44. Data relative to implementation of RSI are being collected. 

45. Data relative to implementation of RSI are used in formative evaluation and in changes in 
the strategic plan. 
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46. Site-specific program evaluation is carried out. 

58. Number of students in targeted programs and the congruence of their curriculum, 
instruction and student assessment, graduation requirements, and quality of the experience 
to the RSI. 

59. Student performance measures are valid and reliable. 

62. Job upon graduation or college attendance information are available. 

88. Outcomes from science and math programs are available for public scrutiny. 

89. Multiple methods are used to assess students and programs. 

9 1 . Efforts are made to follow up on graduates. 

1 02. Percentage of students taking Advanced Placement exams has risen. 

Driver 6 . Improvement in the achievement of all students, including those historically 
underserved. 

28. All students (including historically underserved) show success in courses. 

29. All students (including historically underserved) show increased scores on measures of 
learning. 

101 . Standardized tests show improvement in minority student achievement. 

Conclusions 



The results of the first round of the Delphi process show that 29 indicators were validated by the 
Resource Advisory Team: 4 for Driver 1, 10 for Driver 2, 3 for Driver 3, 5 for Driver 4, 5 for 
Driver 5, and 2 for Driver 6. 

The results of the second round of the Delphi process show that 75 indicators were validated by 
the Resource Advisory Team: 19 for Driver 1, 23 for Driver 2, 10 for Driver 3, 7 for Driver 4, 13 
for Driver 5, and 3 for Driver 6. 

The increase in the number of drivers validated between the first and second rounds of the Delphi 
process represents an increase of 375 percent for Driver 1, 130 percent for Driver 2, 233 percent 
for Driver 3, 40 percent for Driver 4, 160 percent for Driver 5, and 50 percent for Driver 6. 

As a result of the identification and expert validation of indicators for each NSF driver of systemic 
reform, the evaluation study of the rural systemic reform initiative will have a set of indicators to 
guide its work during on-site studies in 6-7 rural communities. The study team will seek evidence 
of the presence of each of the six drivers and attempt to determine the perceived value of the 
drivers in these communities. 
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INDICATORS 


9. Policies strengthen the emphasis on mathematics, science, and 
technology. 


10. Policies support the preservice education of teachers. 


1 1 . Policies assure adequate time for the ongoing professional 
development of teachers. 


12. Policies require a tight alignment among curriculum, 
instruction, assessment, and professional development. 


13. Policies assure adequate financial and administrative support 
for the ongoing professional development of teachers. 


14. Policies designed to recognize and reward excellence in 
teaching. 


15. Policies support the system’s capacity to collect and use 
data for continuous program improvement. 


16. Existing funding sources support systemic reform. 


17. Additional funds have been leveraged in support of 
improving education. 


1 8. There is coordination between the initiative and other 
stakeholders. 


19. The general theories and specific recommendations of 
outside experts have been used to support education. 
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INDICATORS 


30. Number and percentage of students presently afFected by 
global system changes. 


3 1 . Number and percentage of teachers presently affected by 
global system changes. 


32. Graduation requirements were changed. 


33. Remedial courses have been removed from the curriculum. 


34. Professional development requirements have been changed. 


35. Teacher certification requirements were changed. 


36. Accountability measures were developed for all system 
levels. 


37. The budget percentage dedicated to education increased. 


38. Percentage of targeted funds such as Title I, Perkins, and 
Eisenhower used in direct support of RSI. 


; 

39. There have been changes in the student to teacher ratio. 


40. Other professionals inside and outside the system are used. 


41. Facilities provide access to learning technologies. 


42. A cabinet level position oversees implementation of RSI. 


43. There has been an increase in supervisors. 


44. Data relative to implementation of RSI are being collected. 
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INDICATORS 


82. Curriculum/instruction are relevant to the locale of the 
student. 


83. Qualified teachers are encouraged to remain in rural, small 
schools. 


84. Resources are made available for work beyond the school 
dav/vear on planned, focused areas. 


85. Funds are pooled to enhance professional development and 
other activities for improvement. 


86. RSI activities act as catalysts for reform in other disciplinary 
areas. 


87. RSI courses are taught/offered regularly across K-12 levels. 


88. Outcomes from science and math programs are available for 
public scrutiny. 


89. Multiple methods are used to assess students and programs. 


90. School personnel pay attention to student attitudes. 


91. Efforts are made to follow up on graduates. 


92. A sound teacher evaluation system is in place. 


93. Teachers assess students’ perceptions of school and the 
value they have for the present and future. 


94. Students have opportunities to learn about careers and 
educational requirements in science and math. 
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INDICATORS 


108. The district’s stated curriculum and instruction mission are 
grounded on sound principles. 


109. Curriculum and instruction goals are coordinated with 
relevant need areas. 


110. Procedures for developing and modifying curriculum and 
instruction objectives are in place. 


111. Major contextual factors influence curriculum. 


112. Special curriculum and instruction addresses the needs of 
target groups. 


113. Qualifications, assignment, and support of personnel in the 
curriculum area. 


114. Physical and psychological environment in which 
curriculum and instruction occur. 


115. Student and teacher scheduling strategies vis-a-vis district 
priorities and individual needs/aspirations. 


1 16. Curriculum activities are organized to promote continuity 
of learning for students. 


117. Activities are selected and arranged to provide a broad and 
coordinated educational program. 


118. Existing conditions affect instruction. 


1 19. Instructional activities are systematically planned, 
organized, and implemented in light of curricular goals. 
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The Resource Advisory Team 



Members of the Resource Advisory Team were carefully selected to provide a broad base of 
knowledge and experience that will be used throughout the study and that will serve to enhance 
the credibility of the findings. Each team member is listed below with institutional affiliation and a 
brief description of the area of expertise that is applicable to this study. All of these individuals 
have agreed to participate as defined in the proposal. Their resumes were not included with the 
proposal, but are available at The Evaluation Center and may be reviewed on request. 

Dr. Larrv Enochs — professor and director of a science teaching/science education center at the 
University of Wisconsin-Milwaukee. Dr. Enochs has worked professionally in Kansas, Texas, and 
Wisconsin in pre- and inservice science education activities. He has worked at NSF and has a 
good understanding of the goals of the systemic initiatives. With a focus on secondary school 
science, he will focus his efforts with this study on teacher preparation, the science curriculum, 
and impact on the secondary school. His interest in using the immediate environment as a 
laboratory for science instruction will be particularly valuable as we examine the extent and the 
effectiveness of this in the RSI collaboratives. 



Dr. Gene Hall — Research Professor, University of Northern Colorado. Dr. Hall was prepared as 
a science educator at the doctoral level, and he is well known for his work in science education. 

His work in developing and using the Concerns Based Adoption Model (CBAM) is well known in 
efforts to implement innovations and influence school reform. As we identify issues and concerns 
about implementation of innovations in the curriculum and the operations of schools, his expertise 
will be highly useful. 

Dr Marv Harris — College of Education and Human Development, University of North Dakota. 

As dean of a college with major responsibilities for developing teachers as rural educators, she is 
well experienced in the preparation of teachers for rural areas and for school-university relations 
and collaboratives. In addition, she has a strong background in multiethnic studies and gender 
considerations in instruction at the elementary and middle school/junior high school level. Her 
work in the Dakotas will be particularly helpful in working with rural systemic efforts in that area. 

Dr James Jess — Superintendent, CAL (Iowa) Community Schools. Dr. Jess has served for many 
years as a superintendent of one of the most highly recognized rural schools in the U S. He has 
developed exemplary programs and introduced numerous innovations in a small consolidated rural 
school district. He has played an important role in the development of legislation and public 
funding policies for small schools. His involvement will focus on school organizations within the 
RSI, the development of appropriate curricular responses for rural students, and administrative 
support mechanisms for innovation. 

Mr. Paul Nachtigal — Executive Director of the Annenberg Rural Challenge Project, with national 
offices in Granby, Colorado. Paul Nachtigal has served as a teacher and administrator in rural 
schools, but he is probably best known for study of rural education and his work with various 
foundations, including the Ford Foundation, with an emphasis on studying leadership in poor, 
rural communities. As head of the parallel rural initiative through the Annenberg project, he will 
provide a useful link to this effort and the introduction of innovations in rural schools and the 
development of functional collaboratives. 
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Dr. Joseph Newlin — Executive Director of the National Rural Education Association (NREA) 
and professor at Colorado State University. With graduate education in adult and rural education 
and his experiences with NREA, he will be a valuable resource for the study as it focuses on 
studying the potential/planned/real impact on rural communities and the development of 
leadership within the collaboratives. Representing rural education, he has participated on a 
number of select committees to identify exemplary schools for national recognition. 

Dr. Steve Oliver — Department of Science Education, University of Georgia. He has worked as a 
science educator at the university level in Georgia and Kansas, conducted numerous workshops 
for teachers and administrators in schools serving rural communities, and is actively engaged in 
the study of science curriculum for small/rural schools. 

Dr. Jack Sanders — currently Executive Director of SERVE in Greensboro, North Carolina. Dr. 
Sanders has conducted considerable research in rural education and served as an administrator at 
the Appalachia Regional Laboratory, where the rural ERIC system is located. He has been active 
in rural organizations, and he will be particularly helpful to this project as we study the use of 
external services and effective organizational structures of educational institutions and agencies. 

Dr. Daniel Stufflebeam — Director of The Evaluation Center, Western Michigan University. Well 
known for his development and use of the CIPP Model for evaluation, Dr. Stufflebeam is 
internationally known for his work in program and personnel evaluation. He will serve as a major 
resource for our study of the context, outcomes, and impact of the various RSIs and the 
interpretation of the data in relation to the drivers. 

Dr. William Webster — Recently retired as head of the research and evaluation unit of the Dallas, 
Texas, school district and a longtime collaborator with the WMU Evaluation Center. Dr. Webster 
is nationally known for his work with student achievement data and the application of analysis for 
studies of teacher and school effectiveness. He brings to the study an exceptional understanding 
of student achievement and, with this background, he will oversee the interpretation of data and 
its use in determining the effectiveness of the RSI. Additionally, he will be able to provide us with 
a perspective of the uniqueness of rural/small schools from the perspective of a large, urban 
school district. 

Alternate: Dr. Angelo Collins — Peabody College, Vanderbilt University. Although not 
designated as a member of the Resource Advisory Team at this time, she has expressed a 
willingness to serve during the latter period of the project (Years 2 and 3) as requested and as 
appropriate for her area(s) of interest and expertise. She has worked as a science educator in the 
public schools and at the university. She has done extensive work in developing national science 
education standards, teaching standards (National Board for Professional Teaching Standards), 
and subject matter assessments for science teachers. 

In summary, we have constituted a resource based advisory team with a broad base of expertise 
and experiences in rural education, science teaching and science education, student achievement, 
evaluation, innovation/reform, school administration, standards/curricula and testing/student 
achievements. This is a group of professionals who provide immediate credibility to this study. 

We intend to make full use of them in the study of RSIs, in the interpretation of findings, and in 
the various phases and tasks. 



In addition, one or more of the team members will accompany study staff/researchers during the 
site visits to the RSIs. In this role, they will provide ongoing consultation to the staff; in addition 
to a particular assignment related to their area of expertise. As we better understand individual 
sites, a long-term plan and schedule of each member’s involvement will be developed. 
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Question 


D1 


D2 


D3 


D4 


D5 


D6 


NA 


49 


6 


1 


1 




1 
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50 
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1 
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1 
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2 
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7 
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2 


63 
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2 
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1 
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1 




1 
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1 
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2 
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69 
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1 






1 
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7 








2 
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1 






73 






7 






2 
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1 




3 
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1 
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75 
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1 




1 


”21 


2 


76 
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3 1 




1 


1 


1 
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1 


1 




2 




78 
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2 
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79 
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80 
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3 


84 
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90 


2 


2 






2 




2 


91 










7 




1 


92 




4 


1 




2 




1 


93 










6 




2 


94 


4 


1 




2 


2 




2 


95 


3 


• 


2 


t 


2 




2 


96 


1 


A 


2 


> 






1 


97 


! 3 


> 3 


l 2 


\ 








98 


1 








5 


1 4 





ERiC 



49 



Question 


D1 


D2 


D3 


D4 


D5 


D6 


NA 


99 




4 






3 


2 




100 










3 


6 




101 










1 


8 




102 










8 


1 




103 


2 


3 


2 




2 




1 


104 






2 








4 


105 


1 


5 


2 


1 
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106 




4 


1 
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107 


3 




2 




2 
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108 
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4 


1 


1 








109 


5 


3 


2 










110 


1 


5 


2 
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111 


4 


1 




1 
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112 


3 
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1 
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113] 


1 


5 


3 










114 


1 


1 


5 
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115 


1 


3 


2 
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116 
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1 
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117 
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1 




1 


1 


4 


119 


6 


2 


1 
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3 




2 




1 




2 


121 


1 


9 












122 




8 


1 




1 




1 


123 




8 


1 




1 
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Frequency Table 



VAR001 





Frequency 


Percent 


Valid 

Percent 


Cumulative 

Percent 


Valid 1.00 


8 


88.9 


88.9 


88.9 


3.00 


1 


11.1 


11.1 


100.0 


Total 


9 


100.0 


100.0 





VAR002 







Frequency 


Percent 


Valid 

Percent 


Cumulative 

Percent 


Valid 


1.00 


9 


100.0 


100.0 


100.0 



VAR003 





Frequency 


Percent 


Valid 

Percent 


Cumulative 

Percent 


Valid 1.00 


6 


66.7 


66.7 


66.7 


5.00 


3 


33.3 


33.3 


100.0 


Total 


9 


100.0 


100.0 





VAR004 





Frequency 


Percent 


Valid 

Percent 


Cumulative 

Percent 


Valid 1.00 


3 


33.3 


33.3 


33.3 


2.00 


1 


11.1 


11.1 


44.4 


5.00 


4 


44.4 


44.4 


88.9 


6.00 


1 


11.1 


11.1 


100.0 


Total 


9 


100.0 


100.0 





VAR005 





Frequency 


Percent 


Valid 

Percent 


Cumulative 

Percent 


Valid 2.00 


8 


88.9 


88.9 


88.9 


3.00 


1 


11.1 


11.1 


100.0 


Total 


9 


100.0 


100.0 





VAR006 





Frequency 


Percent 


Valid 

Percent 


Cumulative 

Percent 


Valid 2.00 


7 


77.8 


77.8 


77.8 


3.00 


1 


11.1 


11.1 


88.9 


7.00 


1 


11.1 


11.1 


100.0 


Total 


9 


100.0 


100.0 
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VAR007 





Frequency 


Percent 


Valid 

Percent 


Cumulative 

Percent 


Valid 2.00 


8 


88.9 


88.9 


88.9 


4.00 


1 


11.1 


11.1 


100.0 


Total 


9 


100.0 


100.0 





VAR008 





Frequency 


Percent 


Valid 

Percent 


Cumulative 

Percent 


"Vaiid 5!oo 


7 


77.8 


77.8 


77.8 


4.00 


1 


11.1 


11.1 


88.9 


7.00 


1 


11.1 


11.1 


100.0 


Total 


9 


100.0 


100.0 





VAR009 



) 







Frequency 


Percent 


Valid 

Percent 


Cumulative 

Percent 


Valid 


2.00 


9 


100.0 


100.0 


100.0 



VAR010 







Frequency 


Percent 


Valid 

Percent 


Cumulative 

Percent 


Valid 


2.00 


9 


100.0 


100.0 


100.0 



VAR011 







Frequency 


Percent 


Valid 

Percent 


Cumulative 

Percent 


Valid 


2.00 


9 


100.0 


100.0 


100.0 



VAR012 







Frequency 


Percent 


Valid 

Percent 


Cumulative 

Percent 


Valid 


2.00 


9 


100.0 


100.0 


100.0 



VAR013 





Frequency 


Percent 


Valid 

Percent 


Cumulative 

Percent 


Valid 2.00 


8 


88.9 


88.9 


88.9 


3.00 


1 


11.1 


11.1 


100.0 


Total 


9 


100.0 


100.0 
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VAR014 







Frequency 


Percent 


Valid 

Percent 


Cumulative 

Percent 


Valid 


2.00 


9 


lOO.ol 


100.0 


100.0 



VAR015 





Frequency 


Percent 


Valid 

Percent 


Cumulative 

Percent 


Valid 2.00 


8 


88.9 


88.9 


88.9 


5.00 


1 


11.1 


11.1 


100.0 


Total 


9 


100.0 


100.0 





VAR016 





Frequency 


Percent 


Valid 

Percent 


Cumulative 

Percent 


Valid 3.00 


8 


88.9 


88.9 


88.9 


4.00 


1 


11.1 


11.1 


100.0 


Total 


9 


100.0 


100.0 





VAR017 





Frequency 


Percent 


Valid 

Percent 


Cumulative 

Percent 


Valid 3.00 


8 


88.9 


88.9 


88.9 


4.00 


1 


11.1 


11.1 


100.0 


Total 


9 


100.0 


100.0 





VAR018 





Frequency 


Percent 


Valid 

Percent 


Cumulative 

Percent 


Valid 3.00 


2 


22.2 


22.2 


22.2 


4.00 


7 


77.8 


77.8 


100.0 


Total 


9 


100.0 


100.0 





VAR019 





Frequency 


Percent 


Valid 

Percent 


Cumulative 

Percent 


Valid 3.00 


5 


55.6 


55.6 


55.6 


4.00 


4 


44.4 


44.4 


100.0 


Total 


9 


100.0 


100.0 





O 

ERIC 
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VAR020 





Frequency 


Percent 


Valid 

Percent 


Cumulative 

Percent 


Valid 3.00 


8 


88.9 


88.9 


88.9 


4.00 


1 


11.1 


11.1 


100.0 


Total 


9 


100.0 


100.0 





VAR021 





Frequency 


Percent 


Valid 

Percent 


Cumulative 

Percent 


Valid 4.00 


8 


88.9 


88.9 


88.9 


5.00 


1 


11.1 


11.1 


100.0 


Total 


9 


100.0 


100.0 





VAR022 







Frequency 


Percent 


Valid 

Percent 


Cumulative 

Percent 


Valid 


4.00 


9 


100.0 


100.0 


100.0 



VAR023 





Frequency 


Percent 


Valid 

Percent 


Cumulative 

Percent 


Valid 2.00 


1 


11.1 


11.1 


11.1 


4.00 


8 


88.9 


88.9 


100.0 


Total 


9 


100.0 


100.0 





VAR024 





Frequency 


Percent 


Valid 

Percent 


Cumulative 

Percent 


Valid 2.00 


1 


11.1 


11.1 


11.1 


4.00 


8 


88.9 


88.9 


100.0 


Total 


9 


100.0 


100.0 





VAR025 





Frequency 


Percent 


Valid 

Percent 


Cumulative 

Percent 


Valid 3.00 


1 


11.1 


11.1 


11.1 


5.00 


8 


88.9 


88.9 


100.0 


Total 


9 


100.0 


100.0 






VAR026 





Frequency 


Percent 


Valid 

Percent 


Cumulative 

Percent 


Valid 5.00 


3 


33.3 


33.3 


33.3 


6.00 


6 


66.7 


66.7 


100.0 


Total 


9 


100.0 


100.0 





VAR027 





Frequency 


Percent 


Valid 

Percent 


Cumulative 

Percent 


Valid 5.00 


3 


33.3 


33.3 


33.3 


6.00 


6 


66.7 


66.7 


100.0 


Total 


9 


100.0 


100.0 





VAR028 





Frequency 


Percent 


Valid 

Percent 


Cumulative 

Percent 


Valid 5.00 


1 


11.1 


11.1 


11.1 


6.00 


8 


88.9 


88.9 


100.0 


Total 


9 


100.0 


100.0 





VAR029 





Frequency 


Percent 


Valid 

Percent 


Cumulative 

Percent 


Valid 5.00 


1 


11.1 


11.1 


11.1 


6.00 


8 


88.9 


88.9 


100.0 


Total 


9 


100.0 


100.0 





VAR030 





Frequency 


Percent 


Valid 

Percent 


Cumulative 

Percent 


Valid 5.00 


7 


77.8 


77.8 


77.8 


7.00 


2 


22.2 


22.2 


100.0 


Total 


9 


100.0 


100.0 





VAR031 





Frequency 


Percent 


Valid 

Percent 


Cumulative 

Percent 


Valid 1.00 


1 


11.1 


11.1 


11.1 


2.00 


2 


22.2 


22.2 


33.3 


5.00 


3 


33.3 


33.3 


66.7 


7.00 


3 


33.3 


33.3 


100.0 


Total 


9 


100.0 


100.0 
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VAR032 





Frequency 


Percent 


Valid 

Percent 


Cumulative 

Percent 


Valid 2.00 


3 


33.3 


33.3 


33.3 


4.00 


1 


11.1 


11.1 


44.4 


5.00 


5 


55.6 


55.6 


100.0 


Total 


9 


100.0 


100.0 





VAR033 





Frequency 


Percent 


Valid 

Percent 


Cumulative 

Percent 


Valid 1.00 


6 


66.7 


66.7 


66.7 


2.00 


2 


22.2 


22.2 


88.9 


5.00 


1 


11.1 


11.1 


100.0 


Total 


9 


100.0 


100.0 





VAR034 







Frequency 


Percent 


Valid 

Percent 


Cumulative 

Percent 


Valid 


2.00 


9 


100.0 


100.0 


100.0 



VAR035 







Frequency 


Percent 


Valid 

Percent 


Cumulative 

Percent 


Valid 


2.00 


9 


100.0 


100.0 


100.0 



VAR036 







Frequency 


Percent 


Valid 

Percent 


Cumulative 

Percent 


Valid 


5.00 


9 


100.0 


100.0 


100.0 



VAR037 







Frequency 


Percent 


Valid 

Percent 


Cumulative 

Percent 


"Valid 


3.00 


9 


100.0 


100.0 


100.0 



VAR038 





Frequency 


Percent 


Valid 

Percent 


Cumulative 

Percent 


Valid 3.00 


8 


88.9 


88.9 


88.9 


4.00 


1 


11.1 


11.1 


100.0 


Total 


9 


100.0 


100.0 





O 

ERIC 



57 



VAR039 





Frequency 


Percent 


Valid 

Percent 


Cumulative 

Percent 


Valid 2.00 


1 


11.1 


11.1 


11.1 


3.00 


7 


77.8 


77.8 


88.9 


7.00 


1 


11.1 


11.1 


100.0 


Total 


9 


100.0 


100.0 





VAR040 





Frequency 


Percent 


Valid 

Percent 


Cumulative 

Percent 


Valid 3.00 


6 


66.7 


66.7 


66.7 


4.00 


3 


33.3 


33.3 


100.0 


Total 


9 


100.0 


100.0 





VAR041 







Frequency 


Percent 


Valid 

Percent 


Cumulative 

Percent 


Valid 


3.00 


9 


100.0 


100.0 


100.0 



VAR042 





Frequency 


Percent 


Valid 

Percent 


Cumulative 

Percent 


Valid 2.00 


1 


11.1 


11.1 


11.1 


3.00 


5 


55.6 


55.6 


66.7 


4.00 


1 


11.1 


11.1 


77.8 


5.00 


1 


11.1 


11.1 


88.9 


7.00 


1 


11.1 


11.1 


100.0 


Total 


9 


100.0 


100.0 





VAR043 





Frequency 


Percent 


Valid 

Percent 


Cumulative 

Percent 


Valid 2.00 


1 


ii.i 


11.1 


11.1 


3.00 


5 


55.6 


55.6 


66.7 


4.00 


1 


11.1 


11.1 


77.8 


5.00 


1 


11.1 


11.1 


88.9 


7.00 


1 


11.1 


11.1 


100.0 


Total 


9 


100.0 


100.0 





VAR044 







Frequency 


Percent 


Valid 

Percent 


Cumulative 

Percent 


Valid 


5.00 


9 


100.0 


100.0 


100.0 
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VAR045 





Frequency 


Percent 


Valid 

Percent 


Cumulative 

Percent 


Valid 2.00 


1 


11.1 


11.1 


11.1 


3.00 


1 


11.1 


11.1 


22.2 


5.00 


7 


77.8 


77.8 


100.0 


Total 


9 


100.0 


100.0 





VAR046 





Frequency 


Percent 


Valid 

Percent 


Cumulative 

Percent 


Valid 1.00 


1 


11.1 


11.1 


11.1 


5.00 


8 


88.9 


88.9 


100.0 


Total 


9 


100.0 


100.0 





VAR047 

) 





Frequency 


Percent 


Valid 

Percent 


Cumulative 

Percent 


Valid 1.00 


8 


88.9 


88.9 


88.9 


5.00 


1 


11.1 


11.1 


100.0 


Total 


9 


100.0 


100.0 





VAR048 





Frequency 


Percent 


Valid 

Percent 


Cumulative 

Percent 


Valid 2.00 


6 


66.7 


66.7 


66.7 


3.00 


2 


22.2 


22.2 


88.9 


4.00 


1 


11.1 


11.1 


100.0 


Total 


9 


100.0 


100.0 





VAR049 





Frequency 


Percent 


Valid 

Percent 


Cumulative 

Percent 


Valid 1.00 


7 


77.8 


77.8 


77.8 


2.00 


1 


11.1 


11.1 


88.9 


4.00 


1 


11.1 


11.1 


100.0 


Total 


9 


100.0 


100.0 





VAR050 







Frequency 


Percent 


Valid 

Percent 


Cumulative 

Percent 


Valid 


2.00 


9 


100.0 


100.0 


100.0 



O 

ERIC 



59 



VAR051 





Frequency 


Percent 


Valid 

Percent 


Cumulative 

Percent 


Valid 2.00 


7 


77.8 


77.8 


77.8 


3.00 


1 


11.1 


11.1 


88.9 


5.00 


1 


11.1 


11.1 


100.0 


Total 


9 


100.0 


100.0 





VAR052 





Frequency 


Percent 


Valid 

Percent 


Cumulative 

Percent 


Valid 1.00 


4 


44.4 


44.4 


44.4 


2.00 


2 


22.2 


22.2 


66.7 


4.00 


1 


11.1 


11.1 


77.8 


5.00 


2 


22.2 


22.2 


100.0 


Total 


9 


100.0 


100.0 





VAR053 





Frequency 


Percent 


Valid 

Percent 


Cumulative 

Percent 


Valid 1.00 


1 


11.1 


11.1 


11.1 


2.00 


2 


22.2 


22.2 


33.3 


3.00 


4 


44.4 


44.4 


77.8 


4.00 


2 


22.2 


22.2 


100.0 


Total 


9 


100.0 


100.0 





VAR054 





Frequency 


Percent 


Valid 

Percent 


Cumulative 

Percent 


Valid 1.00 


6 


66.7 


66.7 


66.7 


3.00 


2 


22.2 


22.2 


88.9 


4.00 


1 


11.1 


11.1 


100.0 


Total 


9 


100.0 


100.0 





VAR055 





Frequency 


Percent 


Valid 

Percent 


Cumulative 

Percent 


Valid 3.00 


6 


66.7 


66.7 


66.7 


5.00 


1 


11.1 


11.1 


77.8 


7.00 


2 


22.2 


22.2 


100.0 


Total 


9 


100.0 


100.0 





O 

ERIC 



60 
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VAR056 





Frequency 


Percent 


Valid 

Percent 


Cumulative 

Percent 


Valid 1.00 


7 


77.8 


77.8 


77.8 


4.00 


1 


11.1 


11.1 


88.9 


7.00 


1 


11.1 


11.1 


100.0 


Total 


9 


100.0 


100.0 





VAR057 





Frequency 


Percent 


Valid 

Percent 


Cumulative 

Percent 


Valid 1.00 


3 


33.3 


33.3 


33.3 


2.00 


1 


11.1 


11.1 


44.4 


3.00 


2 


22.2 


22.2 


66.7 


4.00 


1 


11.1 


11.1 


77.8 


7.00 


2 


22.2 


22.2 


100.0 


Total 


9 


100.0 


100.0 





VAR058 





Frequency 


Percent 


Valid 

Percent 


Cumulative 

Percent 


Valid 1.00 


1 


11.1 


11.1 


11.1 


4.00 


1 


11.1 


11.1 # 


22.2 


5.00 


7 


77.8 


77.8 


100.0 


Total 


9 


100.0 


100.0 





VAR059 





Frequency 


Percent 


Valid 

Percent 


Cumulative 

Percent 


Valid 5.00 


8 


88.9 


88.9 


88.9 


6.00 


1 


11.1 


11.1 


100.0 


Total 


9 


100.0 


100.0 





VAR060 





Frequency 


Percent 


Valid 

Percent 


Cumulative 

Percent 


Valid 1.00 


1 


11.1 


11.1 


11.1 


5.00 


2 


22.2 


22.2 


33.3 


6.00 


5 


55.6 


55.6 


88.9 


7.00 


1 


11.1 


11.1 


100.0 


Total 


9 


100.0 


100.0 





O 

ERIC 



VAR061 





Frequency 


Percent 


Valid 

Percent 


Cumulative 

Percent 


Valid 1.00 


3 


33.3 


33.3 


33.3 


5.00 


5 


55.6 


55.6 


88.9 


6.00 


1 


11.1 


11.1 


100.0 


Total 


9 


100.0 


100.0 





VAR062 





Frequency 


Percent 


Valid 

Percent 


Cumulative 

Percent 


Valid 5.00 


8 


88.9 


88.9 


88.9 


7.00 


1 


11.1 


11.1 


100.0 


Total 


9 


100.0 


100.0 





VAR063 





Frequency 


Percent 


Valid 

Percent 


Cumulative 

Percent 


Valid 3.00 


1 


11.1 


11.1 


11.1 


4.00 


8 


88.9 


88.9 


100.0 


Total 


9 


100.0 


100.0 





VAR064 





Frequency 


Percent 


Valid 

Percent 


Cumulative 

Percent 


Valid 1.00 


8 


88.9 


88.9 


88.9 


2.00 


1 


11.1 


11.1 


100.0 


Total 


9 


100.0 


100.0 





VAR065 — • 





Frequency 


Percent 


Valid 

Percent 


Cumulative 

Percent 


Valid 1.00 


1 


11.1 


11.1 


11.1 


4.00 


8 


88.9 


88.9 


100.0 


Total 


9 


100.0 


100.0 





VAR066 







Frequency 


Percent 


Valid 

Percent 


Cumulative 

Percent 


Valid 


1.00 


9 


100.0 


100.0 


100.0 
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VAR067 





Frequency 


Percent 


Valid 

Percent 


Cumulative 

Percent 


Valid 1.00 


1 


11.1 


11.1 


11.1 


4.00 


6 


66.7 


66.7 


77.8 


5.00 


2 


22.2 


22.2 


100.0 


Total 


9 


100.0 


100.0 





VAR068 





Frequency 


Percent 


Valid 

Percent 


Cumulative 

Percent 


Valid 1.00 


1 


11.1 


11.1 


11.1 


4.00 


5 


55.6 


55.6 


66.7 


5.00 


1 


11.1 


11.1 


77.8 


6.00 


1 


11.1 


11.1 


88.9 


7.00 


1 


11.1 


11.1 


100.0 


Total 


9 


100.0 


100.0 





VAR069 





Frequency 


Percent 


Valid 

Percent 


Cumulative 

Percent 


Valid 1.00 


8 


88.9 


88.9 


88.9 


2.00 


1 


11.1 


11.1 


100.0 


Total 


9 


100.0 


100.0 





VAR070 





Frequency 


Percent 


Valid 

Percent 


Cumulative 

Percent 


Valid 1.00 


8 


88.9 


88.9 


88.9 


2.00 


1 


11.1 


11.1 


100.0 


Total 


9 


100.0 


100.0 





VAR071 





Frequency 


Percent 


Valid 

Percent 


Cumulative 

Percent 


"\7aild TOO 


8 


88.9 


88.9 


88.9 


5.00 


1 


11.1 


11.1 


100.0 


Total 


9 


100.0 


100.0 






VAR072 





Frequency 


Percent 


Valid 

Percent 


Cumulative 

Percent 


Valid 3.00 


2 


22.2 


22.2 


22.2 


4.00 


5 


55.6 


55.6 


77.8 


5.00 


2 


22.2 


22.2 


100.0 


Total 


9 


100.0 


100.0 





VAR073 







Frequency 


Percent 


Valid 

Percent 


Cumulative 

Percent 


Valid 


3.00 


i 9 


100.0 


100.0 


100.0 



VAR074 





Frequency 


Percent 


Valid 

Percent 


Cumulative 

Percent 


Valid 1.00 


2 


22.2 


22.2 


22.2 


2.00 


1 


11.1 


11.1 


33.3 


3.00 


3 


33.3 


33.3 


66.7 


4.00 


1 


11.1 


11.1 


77.8 


5.00 


1 


11.1 


11.1 


88.9 


7.00 


1 


11.1 


11.1 


100.0 


Total 


9 


100.0 


100.0 





VAR075 





Frequency 


Percent 


Valid 

Percent 


Cumulative 

Percent 


Valid 2.00 


4 


44.4 


44.4 


44.4 


4.00 


1 


11.1 


11.1 


55.6 


5.00 


2 


22.2 


22.2 


77.8 


7.00 


2 


22.2 


22.2 


100.0 


Total 


9 


100.0 


100.0 





VAR076 





Frequency 


Percent 


Valid 

Percent 


Cumulative 

Percent 


Valid 1.00 


5 


55.6 


55.6 


55.6 


2.00 


1 


11.1 


11.1 


66.7 


4.00 


3 


33.3 


33.3 


100.0 


Total 


9 


100.0 


100.0 
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VAR077 





Frequency 


Percent 


Valid 

Percent 


Cumulative 

Percent 


Valid 1.00 


3 


33.3 


33.3 


33.3 


2.00 


4 


44.4 


44.4 


77.8 


6.00 


1 


11.1 


11.1 


88.9 


7.00 


1 


11.1 


11.1 


100.0 


Total 


9 


100.0 


100.0 





VAR078 





Frequency 


Percent 


Valid 

Percent 


Cumulative 

Percent 


Valid 2.00 


3 


33.3 


33.3 


33.3 


3.00 


1 


11.1 


11.1 


44.4 


4.00 


2 


22.2 


22.2 


66.7 


6.00 


2 


22.2 


22.2 


88.9 


j 7.00 


1 


11.1 


11.1 


100.0 


Total 


9 


100.0 


100.0 





VAR079 







Frequency 


Percent 


Valid 

Percent 


Cumulative 

Percent 


Valid 


1.00 


9 


100.0 


100.0 


100.0 



VAR080 





Frequency 


Percent 


Valid 

Percent 


Cumulative 

Percent 


Valid 2.00 


8 


88.9 


88.9 


88.9 


3.00 


1 


11.1 


11.1 


100.0 


Total 


9 


100.0 


100.0 





VAR081 





Frequency 


Percent 


Valid 

Percent 


Cumulative 

Percent 


Valid 2.00 


7 


77.8 


77.8 


77.8 


3.00 


1 


11.1 


11.1 


88.9 


7.00 


1 


11.1 


11.1 


100.0 


Total 


9 


100.0 


100.0 





VAR082 







Frequency 


Percent 


Valid 

Percent 


Cumulative 

Percent 


Valid 


1.00 


91 


100.0 


100.0 


100.0 





VAR083 





Frequency 


Percent 


Valid 

Percent 


Cumulative 

Percent 


Valid 2.00 


7 


77.8 


77.8 


77.8 


3.00 


1 


11.1 


11.1 


88.9 


4.00 


1 


11.1 


11.1 


100.0 


Total 


9 


100.0 


100.0 





VAR084 







Frequency 


Percent 


Valid 

Percent 


Cumulative 

Percent 


Valid 


3.00 


9 


100.0 


100.0 


100.0 



VAR085 





Frequency 


Percent 


Valid 

Percent 


Cumulative 

Percent 


Valid 2.00 


1 


11.1 


11.1 


11.1 


3.00 


8 


88.9 


88.9 


100.0 


Total 


9 


100.0 


100.0 





VAR086 





Frequency 


Percent 


Valid 

Percent 


Cumulative 

Percent 


Valid 1.00 


1 


in 


11.1 , 


11.1 


3.00 


3 


33.3 


33.3 


44.4 


5.00 


1 


11.1 


11.1 


55.6 


7.00 


4 


44.4 


44.4 


100.0 


Total 


9 


100.0 


100.0 





VAR087 





Frequency 


Percent 


Valid 

Percent 


Cumulative 

Percent 


Valid 1.00 


7 


77.8 


77.8 


77.8 


2.00 


1 


11.1 


11.1 


88.9 


5.00 


1 


11.1 


11.1 


100.0 


Total 


9 


100.0 


100.0 





VAR088 







Frequency 


Percent 


Valid 

Percent 


Cumulative 

Percent 


Valid 


5.00 


9 


100.0 


100.0 


100.0 



66 

o 

ERLC 
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VAR089 





Frequency 


Percent 


Valid 

Percent 


Cumulative 

Percent 


Valid 1.00 


1 


11.1 


11.1 


11.1 


5.00 


8 


88.9 


88.9 


100.0 


Total 


9 


100.0 


100.0 





VAR090 





Frequency 


Percent 


Valid 

Percent 


Cumulative 

Percent 


Valid 1.00 


1 


11.1 


11.1 


11.1 


2.00 


1 


11.1 


11.1 


22.2 


4.00 


1 


11.1 


11.1 


33.3 


5.00 


6 


66.7 


66.7 


100.0 


Total 


9 


100.0 


100.0 





VAR091 





Frequency 


Percent 


Valid 

Percent 


Cumulative 

Percent 


"Vaiia 5!oo 


8 


88.9 


88.9 


88.9 


7.00 


1 


11.1 


11.1 


100.0 


Total 


9 


100.0 


100.0 





VAR092 





Frequency 


Percent 


Valid 

Percent 


Cumulative 

Percent 


Valid 2.00 


6 


66.7 


66.7 


66.7 


5.00 


2 


22.2 


22.2 


88.9 


7.00 


1 


11.1 


11.1 


100.0 


Total 


9 


100.0 


100.0 





VAR093 





Frequency 


Percent 


Valid 

Percent 


Cumulative 

Percent 


Valid 1.00 


2 


22.2 


22.2 


22.2 


5.00 


6 


66.7 


66.7 


88.9 


7.00 


1 


11.1 


11.1 


100.0 


Total 


9 


100.0 


100.0 





VAR094 





Frequency 


Percent 


Valid 

Percent 


Cumulative 

Percent 


Valid 1.00 


8 


88.9 


88.9 


88.9 


6.00 


1 


11.1 


11.1 


100.0 


Total 


9 


100.0 


100.0 






VAR095 





Frequency 


Percent 


Valid 

Percent 


Cumulative 

Percent 


Valid 1.00 


6 


66.7 


66.7 


66.7 


3.00 


2 


22.2 


22.2 


88.9 


5.00 


1 


11.1 


11.1 


100.0 


Total 


9 


100.0 


100.0 





VAR096 





Frequency 


Percent 


Valid 

Percent 


Cumulative 

Percent 


Valid 1.00 


2 


22.2 


22.2 


22.2 


2.00 


5 


55.6 


55.6 


77.8 


7.00 


2 


22.2 


22.2 


100.0 


Total 


9 


100.0 


100.0 





VAR097 





Frequency 


Percent 


Valid 

Percent 


Cumulative 

Percent 


Valid 1.00 


6 


66.7 


66.7 


66.7 


2.00 


3 


33.3 


33.3 


100.0 


Total 


9 


100.0 


100.0 





VAR098 





Frequency 


Percent 


Valid 

Percent 


Cumulative 

Percent 


Valid 5.00 


4 


44.4 


44.4 


44.4 


6.00 


5 


55.6 


55.6 


100.0 


Total 


9 


100.0 


100.0 





VAR099 





Frequency 


Percent 


Valid 

Percent 


Cumulative 

Percent 


Valid 2.00 


5 


55.6 


55.6 


55.6 


5.00 


3 


33.3 


33.3 


88.9 


7.00 


1 


11.1 


11.1 


100.0 


Total 


9 


100.0 


100.0 





VAR100 





Frequency 


Percent 


Valid 

Percent 


Cumulative 

Percent 


Valid 5.00 


3 


33.3 


33.3 


33.3 


6.00 


6 


66.7 


66.7 


100.0 


Total 


9 


100.0 


100.0 
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VAR101 





Frequency 


Percent 


Valid 

Percent 


Cumulative 

Percent 


Valid 5.00 


1 


11.1 


11.1 


11.1 


6.00 


8 


88.9 


88.9 


100.0 


Total 


9 


100.0 


100.0 





VAR102 





Frequency 


Percent 


Valid 

Percent 


Cumulative 

Percent 


Valid 5.00 


7 


77.8 


77.8 


77.8 


6.00 


i 


11.1 


11.1 


88.9 


7.00 


i 


11.1 


11.1 


100.0 


Total 


9 


100.0 


100.0 





VAR103 



) 





Frequency 


Percent 


Valid 

Percent 


Cumulative 

Percent 


Valid .00 


1 


11.1 


11.1 


11.1 


1.00 


2 


22.2 


22.2 


33.3 


2.00 


4 


44.4 


44.4 


77.8 


3.00 


1 


11.1 


11.1 


88.9 


5.00 


1 


11.1 


11.1 


100.0 


Total 


9 


100.0 


100.0 





VAR104 





Frequency 


Percent 


Valid 

Percent 


Cumulative 

Percent 


Valid 3.00 


4 


44.4 


44.4 


44.4 


7.00 


5 


55.6 


55.6 


100.0 


Total 


9 


100.0 


100.0 





VAR105 





Frequency 


Percent 


Valid 

Percent 


Cumulative 

Percent 


"Vaiid Z05 


6 


66.7 


66.7 


66.7 


3.00 


3 


33.3 


33.3 


100.0 


Total 


9 


100.0 


100.0 







VAR106 





Frequency 


Percent 


Valid 

Percent 


Cumulative 
Percent . 


"Vaiid ZOO 


1 


11.1 


11.1 


11.1 


5.00 


3 


33.3 


33.3 


44.4 


6.00 


1 


11.1 


11.1 


55.6 


7.00 


4 


44.4 


44.4 


100.0 


Total 


9 


100.0 


100.0 





VAR107 





Frequency 


Percent 


Valid 

Percent 


Cumulative 

Percent 


Valid 1.00 


5 


55.6 


55.6 


55.6 


3.00 


2 


22.2 


22.2 


77.8 


5.00 


1 


11.1 


11.1 


88.9 


7.00 


1 


11.1 


11.1 


100.0 


Total 


9 


100.0 


100.0 





VAR108 





Frequency 


Percent 


Valid 

Percent 


Cumulative 

Percent 


Valid 1.00 


4 


44.4 


44.4 


44.4 


2.00 


3 


33.3 


33.3 


77.8 


4.00 


1 


11.1 


11.1 


88.9 


5.00 


1 


11.1 


11.1 


100.0 


Total 


9 


100.0 


100.0 





VAR109 





Frequency 


Percent 


Valid 

Percent 


Cumulative 

Percent 


Valid 1.00 


7 


77.8 


77.8 


77.8 


2.00 


1 


11.1 


11.1 


88.9 


3.00 


1 


11.1 


11.1 


100.0 


Total 


9 


100.0 


100.0 





VAR110 





Frequency 


Percent 


Valid 

Percent 


Cumulative 

Percent 


Valid 2.00 


7 


77.8 


77.8 


77.8 


3.00 


1 


11.1 


11.1 


88.9 


5.00 


1 


11.1 


11.1 


100.0 


Total 


9 


100.0 


100.0 





O 

ERLC 



70 



Page 19 



VAR111 





Frequency 


Percent 


Valid 

Percent 


Cumulative 

Percent 


Valid 1.00 


5 


55.6 


55.6 


55.6 


2.00 


2 


22.2 


22.2 


77.8 


3.00 


1 


11.1 


11.1 


88.9 


7.00 


1 


11.1 


11.1 


100.0 


Total 


9 


100.0 


100.0 





VAR112 





Frequency 


Percent 


Valid 

Percent 


Cumulative 

Percent 


Valid 1.00 


5 


55.6 


55.6 


55.6 


2.00 


1 


11.1 


11.1 


66.7 


3.00 


1 


11.1 


11.1 


77.8 


6.00 


1 


11.1 


11.1 


88.9 


7.00 


1 


11.1 


11.1 


100.0 


Total 


9 


100.0 


100.0 





VAR113 





Frequency 


Percent 


Valid 

Percent 


Cumulative 

Percent 


Valid 2.00 


7 


77.8 


77.8 


77.8 


3.00 


1 


11.1 


11.1 


88.9 


4.00 


1 


11.1 


11.1 


100.0 


Total 


9 


100.0 


100.0 





VAR114 





Frequency 


Percent 


Valid 

Percent 


Cumulative 

Percent 


"\7aTid Too 


1 


11.1 


11.1 


11.1 


2.00 


1 


11.1 


11.1 


22.2 


3.00 


4 


44.4 


44.4 


66.7 


7.00 


3 


33.3 


33.3 


100.0 


Total 


9 


100.0 


100.0 





VAR115 





Frequency 


Percent 


Valid 

Percent 


Cumulative 

Percent 


Valid 1.00 


2 


22.2 


22.2 


22.2 


2.00 


4 


44.4 


44.4 


66.7 


3.00 


1 


11.1 


11.1 


77.8 


5.00 


1 


11.1 


11.1 


88.9 


7.00 


1 


11.1 


11.1 


100.0 


Total 


9 


100.0 


100.0 







VAR116 





Frequency 


Percent 


Valid 

Percent 


Cumulative 

Percent 


Valid 1.00 


8 


88.9 


88.9 


88.9 


7.00 


1 


11.1 


11.1 


100.0 


Total 


9 


100.0 


100.0 





VAR117 





Frequency 


Percent 


Valid 

Percent 


Cumulative 

Percent 


Valid 1.00 


7 


77.8 


77.8 


77.8 


2.00 


1 


11.1 


11.1 


88.9 


3.00 


1 


11.1 


11.1 


100.0 


Total 


9 


100.0 


100.0 





VAR118 





Frequency 


Percent 


Valid 

Percent 


Cumulative 

Percent 


Valid 1.00 


1 


11.1 


in 


ii.i 


3.00 


2 


22.2 


22.2 


33.3 


4.00 


1 


11.1 


11.1 


44.4 


7.00 


5 


55.6 


55.6 


100.0 


Total 


9 


100.0 


100.0 





VAR119 





Frequency 


Percent 


Valid 

Percent 


Cumulative 

Percent 


Valid 1.00 


8 


88.9 


88.9 


88.9 


4.00 


1 


11.1 


11.1 


100.0 


Total 


9 


100.0 


100.0 





VAR120 





Frequency 


Percent 


Valid 

Percent 


Cumulative 

Percent 


Valid .00 


1 


11.1 


11.1 


11.1 


1.00 


8 


88.9 


88.9 


100.0 


Total 


9 


100.0 


100.0 





VAR121 





Frequency 


Percent 


Valid 

Percent 


Cumulative 

Percent 


Valid .00 


1 


11.1 


■ 11.1 


11.1 


2.00 


8 


88.9 


88.9 


100.0 


Total 


9 


100.0 


100.0 





O 

ERLC 



72 



Page 21 



VAR122 





Frequency 


Percent 


Valid 

Percent 


Cumulative 

Percent 


Valid .00 


1 


11.1 


11.1 


11.1 


2.00 


8 


88.9 


88.9 


100.0 


Total 


9 


100.0 


100.0 





VAR123 





Frequency 


Percent 


Valid 

Percent 


Cumulative 

Percent 


Valid .00 


1 


11.1 


11.1 


11.1 


2.00 


8 


88.9 


88.9 


100.0 


Total 


9 


100.0 


100.0 
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